A Q-learning approach to automated unmanned air vehicle demining
نویسندگان
چکیده
This paper develops a novel Q-learning approach to unmanned aerial vehicle (UAV) navigation, or path planning, for sensing applications in which an infrared (IR) sensor or camera is installed onboard the UAV for the purpose of detecting and classifying multiple, stationary ground targets. The main advantage of this approach over existing path planning techniques is that the optimal guidance policy is learned via the Q-function, without explicit knowledge of the system models and environmental conditions. As a result, the onboard guidance algorithm can adapt to different sensors, vehicle dynamics, and environmental conditions, without designer intervention, and without the need for accurate modeling of every system component. The approach is demonstrated through a demining application in which a UAV-based IR sensor is capable of determining the optimal altitude for properly detecting and classifying targets buried in a complex region of interest.
منابع مشابه
Q-Learning Approach to Automated Unmanned Air Vehicle (UAV) Demining
This paper develops a Q-learning approach to Unmanned Air Vehicle (UAV) navigation, or path planning, for sensing applications in which an infrared (IR) sensor or camera is installed onboard the UAV for the purpose of detecting and classifying multiple, stationary ground targets. The problem can be considered as a geometric sensor-path planning problem, because the geometry and position of the ...
متن کاملTrim and Maneuverability Analysis Using a New Constrained PSO Approach of a UAV
Performance characteristic of an Unmanned Air Vehicle (UAV) is investigated using a newly developed heuristic approach. Almost all flight phases of any air vehicle can be categorized into trim and maneuvering flights. In this paper, a new envelope called trim-ability envelope, is introduced and sketched within the conventional flight envelope for a small UAV. Optimal maneuverability of the inte...
متن کاملA Biologically Based Chemo-Sensing UAV for Humanitarian Demining
Antipersonnel mines, weapons of cheap manufacture but lethal effect, have a high impact on the population even decades after the conflicts have finished. Here we investigate the use of a chemo-sensing Unmanned Aerial Vehicle (cUAV) for demining tasks. We developed a blimp based UAV that is equipped with a broadly tuned metal-thin oxide chemo-sensor. A number of chemical mapping strategies were ...
متن کاملUnmanned Air System Search and Localization Guidance Using Reinforcement Learning
Requirments for current and future Unmanned Air Vehicles with longer ight endurances have led to a need for an autonomous soaring capability. This paper investigates aircraft ight path guidance for search and localization of Regions of Interest, consisting of atmospheric phenomena. The problem is posed as an o ine agent learning problem, of localizing atmospheric thermal locations and then guid...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012